X-ray image reconstruction from a diffraction pattern alone 
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A solution to the inversion problem of scattering would offer aberration-free diffraction-limited 
3D images without the resolution and depth-of-field limitations of lens-based tomographic systems. 
Powerful algorithms are increasingly being used to act as lenses to form such images. Current image 
reconstruction methods, however, require the knowledge of the shape of the object and the low 
spatial frequencies unavoidably lost in experiments. Diffractive imaging has thus previously been 
used to increase the resolution of images obtained by other means. We demonstrate experimentally 
here a new inversion method, which reconstructs the image of the object without the need for any 
such prior knowledge. 
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The inversion problem of coherent scattering - the re- 
construction of a single-scattering potential from mea- 
surements of scattered intensity in the far-field - has oc- 
cupied physicists for over a century, and arises in fields 
as varied as optics, astronomy, X-ray crystallography, 
medical tomographic imaging, holography, electron mi- 
croscopy and particle scattering generally. A solution 
to this problem would offer diffraction-limited images of 
non-periodic objects without the use or need for a lens. 
The possibility of solving the X-ray phase problem for an 
isolated object was first suggested by Sayre in 1952, 
who pointed out that Bragg diffraction in crystals un- 
dersamples the diffracted intensities EJ The Bragg 
limitation on sampling is lifted for non-periodic objects, 
which allow finer sampling of the diffraction pattern. An 
iterative phase-retrieval method, capable of phasing ad- 
equately sampled diffracted intensity first appeared in 
1972 [j|), followed by important theoretical advances due 
to Fiddy, Bates and others — see for a review. The iter- 
ative algorithm was greatly improved through the intro- 
duction of feedback and compact support (The support 
is the boundary of the object) by Fienup around 1982 
with the hybrid input-output (HIO) algorithm Q, which 
allowed inversions of optical data [a |9(. A significant 
breakthrough occurred in 1999 with the reconstruction 
by Miao and coworkers of a two-dimensional non-periodic 
X-ray image at 0.075 fim resolution from diffraction data 
and a low-resolution image of the object [l^. Subse- 
quent work has produced nano-crystal images at sub- 
micron resolution using hard X-rays [1 1^ and striking 
tomographic images at higher resolution |l2| , using zone- 
plate X-ray images to provide the low-resolution data. 
Images have also been obtained by inversion of exper- 
imental coherent electron diffraction patterns an( i 
further laser-light images [T3 |. In one proposed applica- 
tion, atomic-resolution images might be obtained by the 
inversion of X-ray pulses diffracted from single molecules 
[l5|. More generally, the possibility of using particles 
with low radiation damage has stimulated a burst of re- 



cent activity |l6j|. 

The iterative algorithms, such as the HIO algorithm, 
iterate between real and reciprocal space, applying var- 
ious a priori constraints in each domain. In diffraction 
space, the modulus squared of the diffracted wavefield is 
set equal to the measured diffraction intensities, whereas 
in real space the transmission function of the object is set 
to zero outside the known boundary of the object (the 
support). Other constraints, which have been used, in- 
clude the known sign of the scattering function and the 
various symmetries of the scatterer. These constraints 
may be classified as convex or non-convex, and the theory 
of Brcgman projections can be used to understand their 
convergence properties Q. In theory, and confirmed by 
simulation, the support mask need not trace the exact 
boundary of the object (loose support), and zero (trans- 
parent) regions of the object inside the support may con- 
verge to their correct value without being forced by the 
mask. However, in practice, a less than perfect estimate 
of the support often prevents the reconstruction of the 
correct image ^tJ) _see a ^ so below. Efforts to obtain the 
support function of the object from the support of the 
experimentally accessible autocorrelation function have 
been proposed for special classes of objects using elegant 
geometrical methods ^^)- Methods for inverting Patter- 
son maps to charge densities for crystals and non-periodic 
objects are reviewed in Buerger 19]). Up until now, no 
images have been reconstructed from experimental x-ray 
diffraction patterns of arbitrary objects without a lower- 
resolution image provided by an optic. 

In this article we eliminate the need for this secondary 
image and demonstrate ultrahigh resolution imaging 
without the need for a lens. The object support func- 
tion is determined together with the object itself, without 
additional spatial information. The procedure builds on 
the HIO algorithm, in which constraints are iteratively 
applied in real and reciprocal space, and a feedback pa- 
rameter is used in real space to damp the application of 
the support constraint. Feedback allows this algorithm 
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to emerge from local minima of the invariant error met- 
ric and thus avoid stagnation. The uniqueness of solu- 
tions found by this method has been studied in detail 
[2*0) (Rare ambiguous solutions have been found in two- 
dimensions in cases where the spectrum is factorable). 
Our innovation is the simple but powerful use of the cur- 
rent estimate of the object to determine the support con- 
straint. The first estimate of the support is the support 
of the autocorrelation function 0|. Although this esti- 
mate is far from accurate, it is continually updated by 
thresholding the intensity of a blurred version of the cur- 
rent estimate of the object under reconstruction. Thresh- 
olding traces the boundary of the object at a given in- 
tensity contour. The blurring acts to smooth out noise, 
and provides a form of regularization. In turn, through 
the normal behavior of the HIO algorithm, the improved 
support constraint gives rise to yet a better estimate of 
the object. We find that this method is very stable, and 
converges to the correct support and object for both sim- 
ulated and experimental x-ray diffraction data. The al- 
gorithm also successfully reconstructs complex objects 
(those that cause large variations in the phase of the exit 
wavefield in two dimensions), which hitherto have been 
experimentally difficult to reconstruct @, 0. This 
opens up the possibility of image reconstruction from mi- 
crodiffraction patterns, where the illumination is tightly 
focused on the object. 

Details of the algorithm are as follows. We start from 
the autocorrelation function of the object. This real- 
space map, obtained by Fourier transforming the diffrac- 
tion pattern, displays all "interatomic" vectors, with 
peaks for all vectors between isolated objects, shifted to 
a common origin. It contains many more peaks than 
the object, and, even for an acentric object, possesses a 
center of inversion symmetry. Since the object must fit 
within the autocorrelation function, our first estimate of 
the support is a mask obtained from this function us- 
ing a contour at the 4% intensity level. Both the cor- 
rect object density and its centro-symmetric inversion fit 
within this initially centric mask, however inversion sym- 
metry is progressively lost as the algorithm converges. 
We then apply the HIO algorithm with feedback parame- 
ter (3 = 0.9 and the real space support given by the calcu- 
lated mask. We obtain the part of the diffraction pattern 
covered by a central beamstop from the transform of the 
current estimate of the object. Low frequency compo- 
nents are treated as free parameters. Every 20 iterations 
we convolve the reconstructed image (the absolute value 
of the reconstructed wavefield) with a Gaussian of width 
a (FWHM = 2.3548 a ) to find the new support mask. 
The mask is then obtained by applying a threshold at 
20% of its maximum. The width a is set to 3 pixels 
in the first iteration, and reduced by 1% every 20 iter- 
ations down to a minimum of 1.5 pixels. Similarities of 
the original Gerchberg-Saxton algorithm with the "sol- 
vent flattening" method suggest that this method could 



be extended to crystallography. 

We have tested the method using two-dimensional ex- 
perimental data as well as two- and three-dimensional 
sets of simulated data. The experimental soft X-ray 
transmission diffraction pattern from two clusters of gold 
balls of 50±5 nm diameter deposited on a silicon nitride 
window was recorded at the Advanced Light Source at 
the Lawrence Berkeley Laboratory, usin g so ft x-rays soft 
x-rays with a wavelength of 2.1 nm [2lll22l|. In Figure Q] 
we present the experimental diffraction pattern and the 
sequence of images produced by the algorithm as it con- 
verges. As shown in the first step, the algorithm starts 
with a support mask with perfect inversion symmetry. 
After a few iterations the symmetry is broken. First, one 
of the three regions of the mask disappears, and then the 
support envelope shrinks progressively around the gold 
ball objects. Finally, a stable solution showing excellent 
agreement with a scanning electron microscope image of 
the same object is obtained. The solution also agrees well 
with a previous reconstruction by a different method |2lj | . 
Note that we would not expect a perfect match between 
the electron and x-ray images, since image formation pro- 
cesses are different for electrons and x-rays. Repeated 
computational trials have all shown the same degree of 
convergence to the correct image or its centro-symmetric 
inversion. Although after a few hundred iterations the 
algorithm always converged to the correct image (inde- 
pendent of the initial random choice of phases), as it- 
erations were carried further both the support and the 
image show arbitrary displacements due to the transla- 
tional invariance of the solution. 

To further assess the validity of the algorithm we have 
tested it on several sets of simulated diffraction patterns 
from gold spheres and gray-scale images. The simula- 
tions all include noise and the loss of data due to a central 
beam-stop. They show that the algorithm is successful 
to the same degree as the standard HIO algorithm with 
tight support. As examples, we include in Figure [3 the 
reconstructions of: a grayscale image; a 3D cluster of 
gold balls (ball diameter of 50±5 nm); and a complex 
object illuminated by a focused beam. The greyscale im- 
age demonstrates that the algorithm does not require any 
"atomicity" constraint provided by the gold balls. The 
particular 3D cluster was chosen to have a small number 
of balls for visualization purposes - the algorithm also 
works with a much larger number of balls. The third ex- 
ample is of particular interest since it is well known that 
the reconstruction of complex objects is much more diffi- 
cult than real objects, but is possible using either disj oint, 
precisely known or specially shaped supports |l4 Il7| . 
Complex objects arise in optics and X-ray diffraction in 
two-dimensions when large phase-shifts occur within the 
cikonal approximation, or if that approximation fails, in 
the presence of spatially dependant absorption effects, 
and in the presence of multiple scattering. The question 
arises as to whether our new method provides a suffi- 
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FIG. 1: Image reconstruction from an experimental X-ray diffraction pattern, (a) X-ray diffraction pattern of a sample of 50 
nm colloidal gold particles, recorded at a wavelength of 2 nm. (b) to (e) shows a sequence of images produced by the algorithm 
as it converges. Number of iterations: 1 (b), 20 (c), 100 (d), 1000 (e). The reconstruction progresses from the autocorrelation 
function in (b) to an image in (e) with a steady improvement of the support boundary (shown at bottom of each frame). 
For comparison a SEM micrograph of the object is shown in (f). The scale bar length is 300 nm and the resolution of our 
reconstructed image is about 20 nm. 




FIG. 2: (Color online) Image reconstructions from simulated 
diffraction patterns of a gray-scale image (top row), a 3-D 
cluster of gold balls (center row) and a complex object illumi- 
nated with a complex focussed probe (bottom row). In each 
row (a) is the recovered object, (b) the recovered support and 
(c) the original image. The greyscale image demonstrates that 
the algorithm does not depend on any "atomicity" constraint 
provided by the gold balls. For the complex object the real 
part is shown, blue is negative, red/yellow is positive. 



ciently tight support, especially for objects fragmented 
into separated parts, to allow the inversion of complex 
objects. Figure |21 (bottom) shows the reconstruction of 
a cluster of gold balls where each ball is multiplied by 



a constant random phase shift between and 2ir. The 
cluster is singled-out from neighbouring ones by a focused 
beam. A perfect match between object and reconstruc- 
tion is again observed if one takes into account the trans- 
lation and constant phase invariance in the solution. The 
result is significant because it relaxes the requirement for 
plane-wave illumination. The generality of the technique 
is thus increased because now the focused probe can be 
used to isolate objects in the image field. 

We have compared the behaviour of our algorithm to 
that of the HIO algorithm. The HIO algorithm requires 
the support a priori, and as is well known the error in the 
reconstruction decreases as the support becomes tighter 
and closer to the actual boundary of the object. This is 
illustrated in Fig. which shows plots of the reconstruc- 
tion error, as a function of Poisson noise in the diffraction 
intensities, for the HfO algorithm with support masks of 
various degrees of accuracy. The masks for these cases 
were calculated by convolving the object by Gaussians 
of various widths (0.5, 5, and 25 pixels) and threshold- 
ing at 5% level from the maximum. This corresponds 
to knowing the shape of the object to a given resolu- 
tion. It is seen that even for low noise, HIO can achieve 
a reasonable reconstruction only if the support mask is 
set to the boundary known at essentially the same res- 
olution to which we are reconstructing the object. The 
reconstruction error for our algorithm (which does not 
require a priori knowledge of the support) is also plot- 
ted in Figure We expect that the noise level at which 
our algorithm fails to reconstruct occurs when the noise 
in real space becomes larger than the threshold used to 
update the support. At this noise level the estimate of 
the support will be influenced by the noise, and the al- 
gorithm will be unable to converge to the correct bound- 
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ary. This suggests that the optimum threshold setting 
depends on the noise level in the data, and we will only 
be able to reconstruct those parts of the object where 
the contrast is above the noise. As the support used in 
the HIO algorithm becomes looser, we observe our algo- 
rithm to be much superior, even in the presence of noise. 
This is because our algorithm always improves upon the 
support and so makes optimal use of the available in- 
formation. The only prior knowledge needed is that the 
object possesses compact support (i.e. is isolated), so 
that oversampling diffraction conditions can be guaran- 
teed experimentally, and that the contrast of the object 
is above the noise. By comparison with earlier methods 
[lfj| . no knowledge of the shape of the object is required. 
There are few adjustable parameters in our algorithm; 
namely, support resolution, support threshold, and feed- 
back parameter. Additional constraints can be added to 
strengthen converge nce, such as atomicity, positivity and 
histogram matching j'2.1 1 2 - ll | . 
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FIG. 3: (Color online) Reconstruction error of the new al- 
gorithm and the HIO algorithm for a complex object as a 
function of Poisson noise in the diffraction image (N is the 
maximum number of photons per pixel, iVo = 2 17 ). In the 
HIO algorithm increasingly looser supports (support 1-4) are 
used: support 1, 2 and 3 are obtained by thresholding the orig- 
inal image after convolving with a Gaussian of 0.5, 5 and 25 
pixels width. Support 4 is obtained from the autocorrelation. 
The HIO algorithm with perfect support (supportl) works 
well even for high noise levels whereas it always fails with 
loose supports (supports 3,4). The new algorithm (shrink- 
ing support) is superior to the HIO with limited knowledge 
of the support shape (support 3,4). Our algorithm fails when 
the noise in real space becomes larger than the threshold used 
to update the support. 

The combination of an apparatus to measure large- 
angle diffraction patterns with our new method of 
data analysis forms a new type of diffraction-limited, 
aberration-free tomographic microscopy. The absence 
of inefficient optical elements makes more efficient use 



of damaging radiation, while the reconstruction from a 
three-dimensional diffraction data set will avoid the cur- 
rent depth-of-field limitation of zone-plate based tomog- 
raphy. The use of focused illumination will allow users 
to select either one or two-part objects (which may be 
complex) from a field. The conditions of beam energy 
and monochromatization used in these preliminary ex- 
periments are far from optimum for diffractive imaging 
and can be greatly improved to reduce recording times by 
more than two orders of magnitude. We expect this new 
microscopy to find many applications. Since dose scales 
inversely as the fourth power of resolution, existing mea- 
surements of damage against resolution can be used to 
show that statistically significant images of single cells 
should be obtainable by this method at 10 nm resolution 
in the 0.5-10 /jm thickness range under cryomicroscopy 
conditions. Imaging by harder coherent X-rays of in- 
organic nanostructures (such as mesoporous materials, 
aerosols and catalysts) at perhaps 2 nm resolution can 
be expected. Atomic-resolution diffractive imaging by 
coherent electron nanodiffraction has now been demon- 
strated |25|. The imaging of dynamical systems, imaging 
with new radiations for which no lenses exist, and single 
molecule imaging with X-ray free-electron laser pulses re- 
main to be explored. 
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